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Sensitivity  analysis  plays  an  important  role  in  building  energy  analysis.  It  can  be  used  to  identify  the 
key  variables  affecting  building  thermal  performance  from  both  energy  simulation  models  and 
observational  study.  This  paper  is  focused  on  the  application  of  sensitivity  analysis  in  the  field  of 
building  performance  analysis.  First,  the  typical  steps  of  implementation  of  sensitivity  analysis  in 
building  analysis  are  described.  A  number  of  practical  issues  in  applying  sensitivity  analysis  are  also 
discussed,  such  as  the  determination  of  input  variations,  the  choice  of  building  energy  programs,  how 
to  reduce  computational  time  for  energy  models.  Second,  the  sensitivity  analysis  methods  used  in 
building  performance  analysis  are  reviewed.  These  methods  can  be  categorized  into  local  and  global 
sensitivity  analysis.  The  global  methods  can  be  further  divided  into  four  approaches:  regression, 
screening-based,  variance-based,  and  meta-model  sensitivity  analysis.  Recent  research  has  been 
concentrated  on  global  methods  because  they  can  explore  the  whole  input  space  and  most  of  them 
allow  the  self-verification,  i.e.,  how  much  variance  of  the  model  output  (building  energy  consumption) 
has  been  explained  by  the  method  used  in  the  analysis.  Third,  we  discuss  several  important  topics, 
which  are  often  overlooked  in  the  domain  of  building  performance  analysis.  These  topics  include  the 
application  of  sensitivity  analysis  in  observational  study,  how  to  deal  with  correlated  inputs,  the 
computation  of  the  variations  of  sensitivity  index,  and  the  software  issues.  Lastly,  the  practical  guidance 
is  given  based  on  the  advantages  and  disadvantaged  of  different  sensitivity  analysis  methods  in 
assessing  building  thermal  performance.  The  recommendations  for  further  research  in  the  future  are 
made  to  provide  more  robust  analysis  in  assessing  building  energy  performance. 
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1.  Introduction 

Sensitivity  analysis  is  a  valuable  tool  for  both  energy  simula¬ 
tion  models  and  observational  study  in  building  energy  analysis. 
Therefore,  sensitivity  analysis  has  been  widely  used  to  explore  the 
characteristics  of  building  thermal  performance  in  various  types 
of  applications,  such  as  building  design  [1,2],  calibration  of  energy 
models  [3,4],  building  retrofit  [5,6],  building  stock  [7,8],  impact  of 
climate  change  on  buildings  [9,10]. 

The  methodology  for  sensitivity  analysis  is  the  same  in 
different  types  of  application  in  building  energy  analysis.  Fig.  1 
shows  typical  steps  for  implementing  sensitivity  analysis  in 
building  performance  analysis:  determine  input  variations;  create 
building  energy  models;  run  energy  models;  collect  simulation 
results;  run  sensitivity  analysis;  presentation  of  sensitivity  ana¬ 
lysis  results.  The  main  difference  among  these  applications  is  the 
variations  (uncertainty  or  probability  distributions)  of  input 
factors  for  different  research  purposes,  which  is  often  overlooked 
or  not  emphasized  enough  in  the  field  of  building  analysis. 
For  instance,  the  thermo-physical  properties  of  building  envelope 
can  be  regarded  as  normal  distributions  when  comparing  simu¬ 
lated  energy  to  actual  monitored  energy  consumption  [11].  This  is 


Determine  variations  (or  probability  distributions)  of  input  factors 


Create  building  energy  models  based  on  input  variations 


[  Run  energy  models  | 


[  Collect  simulation  results  ] 

Run  sensitivity  analysis  ] 


Presentation  of  sensitivity  analysis  results 

Fig.  1.  Typical  schematic  flow  diagram  for  sensitivity  analysis  in  building 
performance  analysis 


because  the  variations  of  inputs  in  this  case  are  due  to  natural 
variations  because  of  construction,  aging,  and  actual  conditions  of 
buildings.  However,  they  should  be  defined  as  uniform  distribu¬ 
tions  when  the  aim  is  to  identify  effective  energy  saving  measures 
in  building  design  [12].  This  is  because  the  design  variables  can  be 
regarded  as  being  equally  probable.  It  is  also  possible  to  combine 
these  natural  uncertainties  (normal  distributions)  and  the  design 
ranges  (uniform  distributions)  together  for  building  physical 
properties.  With  this  end  in  view,  more  complicated  methods 
are  needed,  such  as  two-dimensional  Monte  Carlo  analysis  [13]. 

The  methods  for  sensitivity  analysis  applied  in  the  domain  of 
building  analysis  can  be  divided  into  local  and  global  approaches 
[14]  as  summarized  in  Table  1.  Local  sensitivity  analysis  is  focused 
on  the  effects  of  uncertain  inputs  around  a  point  (or  base  case), 
whereas  global  sensitivity  analysis  is  more  interested  in  the 
influences  of  uncertain  inputs  over  the  whole  input  space  [15], 
Therefore,  the  global  approach  is  regarded  as  a  more  reliable 
method.  The  disadvantages  of  using  global  methods  are  high 
computationally  demanding  compared  to  local  sensitivity  analysis. 
Both  local  [6,16-24]  and  global  methods  have  been  widely  used  in 
building  performance  analysis.  The  global  sensitivity  analysis 
includes  regression  methods[l,2,7-9,13,25-34],  screening-based 
[35-41],  variance-based  [12,15,42-44]  and  meta-modelling 
approaches  [9,45,46].  The  characteristics  of  these  methods  have 
been  summarized  in  Table  1. 

This  paper  is  to  review  the  application  of  sensitivity  analysis  in 
building  thermal  performance  analysis,  provide  the  practical 
advice  on  how  to  effectively  use  sensitivity  analysis  in  different 
settings,  and  make  recommendations  for  applying  sensitivity 
analysis  in  building  performance  analysis  in  the  future.  This  paper 
is  structured  as  follows.  Section  2  describes  the  typical  steps  for 
implementing  sensitivity  analysis  in  building  performance  analy¬ 
sis.  Section  3  reviews  the  methods  used  in  the  field  of  building 
energy  analysis  and  also  comments  on  the  advantages  and  short¬ 
coming  for  these  sensitivity  analysis  approaches.  Section  4  focuses 
on  several  topics  which  are  important,  but  often  overlooked  when 
implementing  sensitivity  analysis  in  building  analysis.  These  topics 
include  how  to  deal  with  correlated  inputs,  calculate  the  variations 
of  sensitivity  measures,  the  differences  between  observational  data 
and  simulation  models  in  using  sensitivity  analysis. 


Table  1 

Comparison  of  sensitivity  analysis  methods  used  in  building  performance  analysis 


Method  Subtype  Characteristics  Literature 


Local  Local  -  Explore  a  reduced  space  of  the  input  factor  around  a  base  case;  low  computational  cost;  simple  to  implement;  [6,16-24] 

easy  to  interpret;  not  consider  interactions  between  inputs;  no  self-verification 

Global  Regression  SRC  SRC  and  t-value,  suitable  for  linear  models;  SRRC,  suitable  for  non-linear  but  monotonic  models;  [1,7-9,25-27,29,34] 

SRRC  moderate  computational  cost  for  energy  models;  fast  to  compute;  easy  to  implement  and  understand;  [2,13,25,30-32] 

t-value  high  SRC  means  more  important  of  the  variable  [10,33] 

Screen  Morris  Suitable  for  a  larger  number  of  inputs  and  computationally  intensive  models;  model-free  approach;  [35-41] 

qualitative  measure  to  rank  factors;  no  self-verification;  not  suitable  for  uncertainty  analysis 
Variance  FAST  Decompose  the  variance  of  the  model  output  for  every  input;  model-free  approach;  consider  both  main  and  [12,42] 

based  Sobol  interactions  effects;  quantitative  measures;  high  computational  cost;  FAST  is  not  suitable  for  discrete  distributions  [44] 

Meta-  MARS  Suitable  for  complex  and  computationally  intensive  models;  [7,45] 

model  ACOSSO  quantify  output  variance  due  to  different  inputs;  [9] 

SVM  the  accuracy  dependent  on  the  meta-model  [46] 


Notes:  SRC,  standardised  regression  coefficients  [47];  SRRC,  standardized  rank  regression  coefficient  [47];  FAST,  Fourier  amplitude  sensitivity  test  [49];  MARS,  multivariate 
adaptive  regression  splines  [52],  ACOSSO,  adaptive  component  selection  and  smoothing  operator  [52],  SVM,  support  vector  machine  [61]. 
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2.  Typical  steps  for  sensitivity  analysis  in  building 
performance  analysis 

This  section  will  describe  the  typical  steps  for  applying 
sensitivity  analysis  in  building  performance  analysis  as  shown 
in  Fig.  1.  We  also  discuss  some  practical  issues,  such  as  the 
determination  of  input  variations,  the  choice  of  building  simula¬ 
tion  programs,  how  to  speed  up  the  calculation  for  building 
energy  models. 

2.1.  Input  variations 

The  first  step  in  sensitivity  analysis  is  to  determine  the  range 
of  the  inputs.  The  probability  distributions  of  the  inputs  also  need 
to  be  defined  if  using  sampling-based  methods,  such  as  variance- 
based  or  Monte  Carlo  sensitivity  analysis  [47].  The  ranges 
(or  distributions)  of  inputs  are  mainly  dependent  on  the  research 
purposes  for  sensitivity  analysis.  The  following  discussion  will  be 
based  on  three  different  settings:  assess  the  energy  performance 
in  a  new  building  using  different  design  options;  explore  the 
variations  of  energy  use  in  an  existing  building;  perform  the 
retrofit  analysis  for  an  existing  building  using  different  energy 
saving  measures. 

The  first  example  is  to  compare  the  energy  performance  for  a 
new  building  using  different  design  options.  The  analyst  should 
focus  on  the  possible  ranges  for  the  design  variables.  In  this  case, 
the  input  variables  can  be  taken  as  discrete  or  continuous  uniform 
distributions  if  we  assume  that  these  variables  are  equally 
probable  [12].  For  example,  the  [/-values  for  building  envelope 
depend  on  different  types  of  insulation  material  or  different 
insulation  thickness  and,  consequently,  the  U  values  are  equally 
likely  to  happen  in  the  design  phase.  Then  sensitivity  analysis  can 
be  used  to  decide  whether  higher  insulation  is  necessary  com¬ 
pared  to  other  energy  saving  measures. 

The  aim  of  the  second  example  is  to  explore  the  possible 
variations  of  energy  use  for  an  existing  building  in  actual  use  and 
find  out  the  key  variables  affecting  them  [11].  Another  purpose 
for  this  example  may  compare  the  simulated  and  measured 
energy  consumption  and  determine  the  main  reasons  to  explain 
the  difference  between  them.  Then  the  analyst  should  concen¬ 
trate  on  the  possible  ranges  for  building  input  factors  in  a  specific 
building.  For  example,  the  [/-value  for  building  envelope  may  be 
regarded  as  normal  distributions  in  this  case  [9[.  This  is  because 
the  [/-value  is  likely  to  be  (or  at  least  approximately)  a  constant 
and  the  variations  of  [/-values  may  be  due  to  insulation  quality, 
construction,  temperature,  age,  maintenance  etc  [48].  Hence, 
normal  distributions  may  be  a  good  choice  for  most  of  the 
variables  in  the  analysis.  The  variables  themselves  may  be  a 
constant  value  for  an  existing  building  and  the  variations  are 
because  of  natural  degradation,  lack  of  knowledge,  or  other 
reasons.  These  distributions  may  need  to  be  truncated  to  avoid 
negative  values  in  some  cases  [13]. 

The  third  example  is  related  to  the  optimization  of  an  existing 
building  by  using  different  insulation  thickness  and  other  mea¬ 
sures.  In  this  case,  more  complicated  methods  might  be  needed. 
This  is  due  to  the  combination  of  the  natural  variations  and  the 
design  variations  of  [/-values  for  building  envelope.  Two- 
dimensional  Monte  Carlo  method  can  be  used  in  this  case  to 
identify  the  key  variables  by  considering  these  two  types  of 
variations  of  input  factors  [13].  This  analysis  includes  two  loops 
to  include  the  two  types  of  effects  separately.  Hence,  it  is 
computationally  expensive  and  the  results  are  hard  to  interpret 
even  for  a  professional  analyst.  A  simple  solution  is  to  only 
consider  the  design  variations  because  the  effects  of  different 
design  options  on  energy  performance  may  be  more  significant 
than  those  from  natural  variations  in  buildings. 


It  should  be  noted  that  how  to  define  the  input  ranges  would 
also  depend  on  the  choice  of  sensitivity  analysis  method.  For  local 
sensitivity  analysis,  it  is  veiy  straightforward  since  it  does  not  need 
sampling  methods  to  generate  combinations  of  inputs.  For  most  of 
global  sensitivity  analysis,  it  is  necessary  to  implement  sampling 
strategies  for  generation  of  sample.  For  regression  and  meta-model 
methods,  Latin-hypercube  sampling  (LHS)  is  very  popular  due  to  its 
efficient  stratification  properties  [47].  LHS  has  been  widely  used  in 
building  performance  analysis  [2,7,25,28,29,43,45].  For  screening 
and  variance-based  methods,  they  usually  require  special  sampling 
methods  for  these  sensitivity  analysis  approaches  [49], 

2.2.  Create  building  energy  models 

For  most  of  sensitivity  analysis  methods,  it  involves  a  large 
number  of  simulation  runs.  Hence,  it  is  necessary  to  automate  the 
process  of  creating  building  energy  models  with  the  different 
combinations  of  the  inputs  from  the  last  step.  A  number  of 
building  simulation  programs  have  been  used  in  sensitivity 
analysis,  such  as  EnergyPlus  [1,9,22,25,31,46,50],  ESP-r  [11,35], 
TRNSYS  [27,43],  and  DOE2  [17].  These  programs  are  very  flexible 
to  be  suitable  for  sensitivity  analysis.  For  example,  the  model 
input  files  for  both  EnergyPlus  and  DOE2  are  text  files,  which  can 
be  easily  processed  using  computer  languages,  such  as  Excel  VBA 
[25],  Matlab  [43].  Another  popular  choice  is  based  on  simplified 
energy  models  [33,36,37],  which  are  fast  to  compute  and  easy  to 
change  inputs.  These  energy  calculation  methods  are  often  based 
on  ISO  13790:2008  (Thermal  Performance  of  Buildings  -  Calcula¬ 
tion  of  Energy  Use  for  Space  Heating  and  Cooling)  or  other  simple 
steady-state  energy  balance  approaches. 

2.3.  Run  building  energy  models 

This  step  is  to  run  a  number  of  simulation  models  created  from 
building  energy  simulation  programs.  This  step  is  usually  the 
most  time-consuming  process  in  the  sensitivity  analysis  in  terms 
of  the  computer  time.  The  calculation  for  sensitivity  analysis 
usually  involves  many  independent  jobs,  i.e.,  many  separate 
building  simulation  models.  Hence,  the  parallel  computing  can 
be  very  helpful  to  speed  up  the  calculation.  There  are  two  types  of 
methods  for  parallel  computing:  single  computer  with  multi-core 
or  multi-processor;  multiple  computers. 

Modern  computers  usually  have  multi  cores  or  processors, 
which  can  be  used  for  this  purpose.  Some  building  energy 
simulation  programs  have  capability  to  use  this  feature.  For 
example,  EnergyPlus  program  can  allow  better  utilization  of  the 
computer  power  by  specifying  the  number  of  simultaneous 
simulation  processes  [51]. 

Another  way  to  expedite  the  calculation  is  using  multiple 
computers.  Tian  et  al.  [9]  used  a  campus  Condor  grid  (PlymGrid, 
around  200  computers)  to  run  2400  EnergyPlus  models  in  order 
to  investigate  the  influences  of  climate  change  on  energy  perfor¬ 
mance  for  a  campus  building.  It  took  only  one  day  to  finish  all 
these  simulation  runs  using  Plymgrid,  while  it  would  need  around 
one  month  if  using  one  normal  specification  office  computer. 
Hygh  et  al.  [1]  used  11-node,  88-core  Linux  cluster  to  run  20000 
EnergyPlus  models  to  quantify  the  sensitivity  of  heating,  cooling, 
and  total  energy  loads  in  four  locations,  USA  [1  ].  Eisenhower  et  al. 
[46]  implemented  a  184-CPU  Linux  cluster  to  run  5000  Energy- 
Plus  models. 

2.4.  Collect  simulation  results 

This  step  is  very  straightforward  to  collect  the  results  from 
building  energy  simulation.  For  sampling-based  methods,  it 
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usually  involves  a  lot  of  data  and  script  languages  can  be  used  to 
automate  this  process. 

2.5.  Run  sensitivity  analysis 

This  step  is  to  run  sensitivity  analysis  based  on  the  inputs  and 
outputs  obtained  from  the  earlier  steps.  The  sensitivity  analysis 
itself  is  usually  not  time  consuming  compared  to  running  building 
energy  models.  However,  this  step  may  take  several  minutes  or 
even  longer  if  using  meta-model  methods  with  larger  number  of 
input  factors  [52].  This  is  because  some  types  of  meta-models  are 
slow  to  build  although  it  takes  much  less  time  in  comparison  with 
running  full  detailed  building  energy  simulation  models.  After 
constructing  meta-models,  it  is  fast  to  run  them  for  sensitivity 
analysis. 

2.6.  Presentation  of  sensitivity  analysis 

There  are  many  ways  to  present  the  results  from  sensitivity 
analysis,  such  as  scatter  plot,  Tornado  plot,  box  plot,  spider  plot. 
Scatter  plots  are  a  good  starting  point  to  explore  the  relationship 
between  inputs  and  outputs  [47],  Burhenne  et  al.  [53]  applied 
scatter  plots  to  investigate  the  effects  of  building  parameters  on 
energy  performance  in  a  typical  German  building.  Tornado  plots 
are  very  useful  to  compare  the  relative  importance  of  different 
input  factors  [1,2,25,28].  The  largest  bar  appears  at  the  top  to  the 
plot  and  the  second  largest  appears  after  that,  and  so  forth.  Pie 
chart  is  also  very  popular  to  show  the  relative  importance  of 
variables  in  building  energy  analysis  [12,43], 

Morris  proposed  a  graphical  representation  to  show  the 
importance  of  each  input  based  on  Morris  method,  which  will 
be  described  in  Section  3.2.2  [54].  The  mean  and  standard 
deviation  of  the  elementary  effects  for  different  inputs  from 
Morris  method  are  plotted  in  a  two-dimensional  graph.  Therefore, 
the  low  values  of  both  the  mean  and  standard  deviation  (in  the 
lower  left  corner  of  the  plot)  indicate  a  non-influential  input, 
while  the  inputs  in  the  upper  right  corner  of  the  plot  are  key 
variables.  The  Morris  plots  have  been  used  in  many  studies  in 
building  analysis  [35,37-40]. 

Spider  and  box  plots  are  not  widely  used  for  sensitivity 
analysis  in  the  field  of  building  performance  analysis.  The  reason 
for  this  is  that  the  sensitivity  analysis  methods  related  to  spider 
and  box  plots  are  rarely  used  in  assessing  building  energy 
performance.  These  two  types  of  plots  do  have  some  advantages 
to  show  the  results  from  sensitivity  analysis.  Spider  plots  are  used 
to  show  the  impact  of  variations  of  input  variables  on  outputs  in 
detail  [55].  The  advantage  of  using  spider  plots  is  that  it  can  show 
whether  there  are  linear  or  non-linear  relationship  between 
inputs  and  outputs.  Box  plots  are  mainly  used  to  show  the 
variations  of  sensitivity  measures  for  different  input  factors 
[52].  However,  most  of  studies  in  building  performance  analysis 
did  not  calculate  the  variations  of  sensitivity  index. 


3.  Sensitivity  analysis  methods  used  in  building  performance 
analysis 

The  section  will  review  the  application  of  sensitivity  analysis 
in  building  energy  analysis.  For  the  technical  details  of  these 
methods,  please  refer  to  [47,49,52,56],  The  focus  in  this  section 
is  on  the  advantages,  disadvantages,  applicability,  and  examples 
of  these  methods  in  assessing  building  thermal  performance. 
Table  1  summarizes  the  characteristics  of  these  methods  and 
the  literature  in  which  these  sensitivity  analysis  methods  have 
been  used  to  assess  building  thermal  performance. 


3.1.  Local  sensitivity  analysis 

Local  sensitivity  analysis  (also  called  differential  sensitivity 
analysis)  belongs  to  the  class  of  the  one-factor-at-a-time  meth¬ 
ods.  Sensitivity  measures  are  usually  calculated  when  one  factor 
is  changed  and  all  other  factors  are  fixed.  As  a  result,  the  choice  of 
base  case  is  very  important  in  this  method.  This  method  has 
apparent  advantages.  It  is  very  straightforward  compared  to 
global  sensitivity  analysis.  As  a  result,  it  is  easily  applied  and 
interpreted.  It  often  needs  less  simulation  runs  in  comparison 
with  global  sensitivity  analysis.  However,  this  method  has  the 
following  drawbacks  [57,58].  First,  it  only  explores  a  reduced 
space  of  the  input  factor  around  a  base  case.  Second,  the  inter¬ 
actions  cannot  be  considered  using  this  method.  Third,  there  is  no 
self-verification  in  this  method,  while  most  of  global  sensitivity 
analysis  can  be  used  to  explain  how  much  variations  of  the 
outputs  are  accounted  by  the  input  factors  [57], 

This  local  sensitivity  analysis  has  been  used  extensively  in  the 
field  of  building  energy  analysis  [6,16-24].  Rasouli  et  al.  [18] 
applied  local  sensitivity  analysis  to  explore  the  thermal  perfor¬ 
mance  for  a  two-storey  office  building  in  Chicago,  Illinois,  USA 
The  results  indicate  that  the  most  important  factor  for  HVAC 
system  energy  is  the  ventilation  rate.  Lam  et  al.  [17]  investigated 
the  energy  performance  of  an  office  building  in  Hong  Kong  using 
DOE-2  program.  The  results  indicate  that  annual  energy  and  peak 
design  loads  are  more  sensitive  to  internal  loads,  window  system, 
temperature  set-points,  and  HVAC  equipment  efficiency.  Dema- 
nuele  et  al.  [22]  used  differential  sensitivity  analysis  to  determine 
the  key  factors  affecting  the  total  energy  use  in  a  UK  school.  It  is 
found  that  the  important  variables  are  related  to  occupants,  such 
as  office  and  class  equipment  load  and  hours  of  use,  heating 
schedule  and  set-point  temperatures. 

3.2.  Global  sensitivity  analysis 
3.2.1.  Regression  method 

Regression  method  is  the  most  widely  used  method  for  sensi¬ 
tivity  analysis  in  building  energy  analysis  [1,2,7-9,13,25-34].  This 
is  because  this  method  is  fast  to  compute  and  easy  to  understand. 
Many  indicators  can  be  used  for  this  purpose  usually  after  Monte 
Carlo  is  being  performed,  such  as  SRC  (Standardised  Regression 
Coefficients),  PCC  (Partial  Correlation  Coefficients),  and  their  rank 
transformation  (SRRC  standardized  rank  regression  coefficient, 
PRCC  partial  rank  correlation  coefficient).  SRC  and  PCC  are  only 
suitable  for  linear  models  and  the  rank  transformation  (SRRC  and 
PCC)  can  be  used  for  non-linear  but  monotonic  functions  among 
inputs  and  outputs.  If  there  is  no  correlation  in  inputs,  SRC  and 
PRC  give  the  same  results  for  ranking  the  importance  of  inputs. 
The  difference  between  SRC  and  PRC  is  that  PRC  is  suitable  for 
correlated  input  because  it  excludes  the  effects  of  correlations 
between  input  factors,  but  the  SRC  is  only  valid  in  the  case  of 
uncorrelated  inputs  [47],  However,  there  are  many  new  sensitivity 
analysis  methods  to  deal  with  correlated  inputs,  which  will  be 
described  in  Section  4.2. 

Another  commonly  used  technique  in  regression  method  is 
stepwise.  The  forward  stepwise  method  is  the  most  widely  used  in 
sensitivity  analysis  [47].  The  most  importance  factor  firstly  enters 
the  model  and  then  the  next  important  factor  also  enter  the  model, 
and  repeat  this  process  until  no  variables  are  significant  in  terms  of 
statistical  test.  The  selection  criterion  includes  SRC,  t-values, 
adjusted  R-square,  and  Akaike  information  criterion. 

The  sensitivity  index  SRC  has  been  widely  used  in  building 
energy  analysis  [1,7-9,25-27,29,34].  Domlnguez-Munoz  et  al. 
[26]  applied  SRC  method  to  determine  the  key  variables  influen¬ 
cing  the  peak  cooling  load  of  a  perimeter  zone  (intermediate 
floor)  in  a  three-story  office  in  the  south  of  Spain.  The  results 
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indicate  that  the  two  most  important  factors  are  internal  thermal 
mass  and  convective  heat  transfer  coefficient  between  the  inter¬ 
nal  mass  and  air.  The  remaining  uncertainties  are  due  to  solar 
gains,  internal  heat  gains,  and  actual  ventilation  level.  Hygh  et 
al.  [1]  used  EnergyPlus  as  a  simulation  tool  to  explore  the  energy 
performance  of  office  buildings  in  four  USA  cities  by  using  SRC 
sensitivity  indicator.  The  results  show  that  the  influences  of 
design  parameters  on  building  energy  use  vary  by  different 
climate  zones.  Ballarini  et  al.  [29]  used  SRC  to  determine  the 
key  variables  affecting  the  cooling  energy  for  a  residential  build¬ 
ing  in  Italy.  The  results  show  that  the  first  three  most  important 
factors  are  solar  shading,  window  area,  and  window  insulation. 
Breesch  et  al.  [27]  applied  SRC  to  determine  the  most  influential 
factors  affecting  thermal  comfort  with  cross  night  ventilation  on 
the  south  side  of  a  typical  office  building  in  Belgium.  They  found 
that  internal  heat  gains  and  air  tightness  are  the  two  most 
important  variables. 

The  use  of  sensitivity  index  SRRC  is  also  reported  in  building 
performance  analysis  [2,13,25,30-32],  Yildiz  et  al.  [25]  investi¬ 
gated  annual  cooling  load  in  low-rise  apartment  in  hot-humid 
climate  using  SRRC  method  with  EnergyPlus  program.  They  found 
that  the  most  sensitive  parameters  affecting  annual  cooling 
energy  are  natural  ventilation,  window  area,  and  solar  heat  gain 
coefficient  (SHGC).  De  Wilde  et  al.  [13]  used  SRRC  as  sensitivity 
measure  to  determine  the  major  contributors  for  heating  energy 
use  in  a  mixed-mode  office  building  in  the  UK  The  results  indicate 
the  infiltration  rate,  lighting  gains,  and  equipment  gains  are  the 
three  most  important  factors  in  this  building. 

Many  other  statistics  can  be  also  used  to  determine  which 
factors  are  important  in  regression  analysis.  These  statistics 
include  t-value,  F-value,  change  of  R2  (coefficient  of  determina¬ 
tions).  The  t-value  is  the  statistic  used  to  test  whether  the 
coefficient  of  the  corresponding  variable  is  zero.  The  higher  the 
absolute  value  of  t  (or  F,  change  of  R2),  the  more  important  is  the 
corresponding  variable.  Zhao  [33]  used  t-value  with  stepwise 
method  in  building  stock  analysis  of  USA  They  found  that  the 
power  use  intensity  from  equipment  is  the  most  important  factor 
for  primary  energy  use  intensity  in  Chicago  area.  De  Wilde  et  al. 
[10]  also  used  t-value  to  show  that  internal  heat  gains  are 
important  factors  for  both  heating  energy  and  overheating  risk 
in  an  office  building  in  the  UK 


3.2.2.  Screening-based  method 

The  purpose  of  screening  method  is  often  to  fix  some  input 
factors  from  a  large  number  of  factors  without  reducing  the 
output  variance  [56].  The  Morris  method  is  the  mostly  used 
screening  method  in  the  field  of  building  performance  analysis 
[35-41].  The  Morris  method  belongs  to  global  sensitivity  analysis 
because  the  baseline  changes  in  every  step  and  the  final  sensi¬ 
tivity  measures  are  calculated  by  averaging  at  different  points  of 
the  input  space.  Input  factors  are  taken  as  a  discrete  number  of 
values  (also  called  levels),  which  are  different  from  other  global 
methods  in  which  input  values  are  directly  from  distributions. 
Two  sensitivity  indexes  can  be  obtained  from  Morris  method  [56]. 
One  (/.()  is  to  estimate  the  main  effect  of  the  input  factor  on  the 
output  and  the  other  (cr)  is  to  assess  the  interaction  with  other 
factor  or  the  non-linear  effects.  A  new  measure  (/(*)  has  been 
proposed  to  estimate  the  total  effects  of  the  input  factor  [56].  This 
method  is  more  suitable  when  there  are  a  few  influential  factors 
and  a  majority  of  non-influential  factors  in  the  project.  The  main 
advantage  using  this  method  is  low  computation  cost  compared 
to  other  global  sensitivity  analysis.  For  example,  the  total  simula¬ 
tion  runs  is  only  36  if  there  are  8  inputs  and  4  levels  for  every 
input  [59],  The  drawback  of  this  method  is  that  this  approach 
tends  to  provide  qualitative  measures  by  ranking  input  factors, 


but  it  cannot  quantify  the  effects  of  different  factors  on  outputs. 
As  a  result,  this  method  does  not  allow  self-verification,  which 
means  the  analyst  does  not  know  how  much  of  the  total  variances 
of  outputs  have  been  taken  into  account  in  the  analysis.  The  other 
types  of  global  sensitivity  analysis  (such  as  regression  or  variance 
based  methods)  can  usually  provide  this  information.  Another 
disadvantage  for  Morris  method  is  that  this  method  does  not 
provide  the  uncertainty  analysis  for  building  energy  performance 
because  the  sampling  method  used  in  this  method  cannot  con¬ 
verge  to  the  population  mean  of  the  model  output  [59], 

The  Morris  method  has  been  widely  used  in  building  energy 
analysis  [35-41].  Heiselberg  et  al.  [38]  implemented  Morris 
method  to  identify  the  key  variables  influencing  energy  use  for 
an  office  building  in  Denmark.  The  results  show  that  the  two  most 
important  variables  are  lighting  control  and  ventilation  during 
the  winter.  Hyun  et  al.  [41  ]  used  Morris  method  to  investigate  the 
performance  of  natural  ventilation  in  a  15-story  residential 
building  in  Korea.  It  is  found  that  the  four  important  factors  are 
wind  velocity,  window  opening  area  by  occupants,  local  terrain 
constant,  and  flow  exponent.  Corrado  et  al.  [37]  used  Morris 
method  to  identify  the  key  factors  for  energy  rating  in  a  house  in 
Italy.  They  found  that  the  five  key  factors  in  decreasing  order 
of  importance  are  indoor  temperature,  air  change  rate,  number  of 
occupants,  metabolic  rate,  and  equipment  heat  gains. 


3.2.3.  Variance-based  method 

The  variance-based  method  is  to  decompose  the  uncertainty  of 
outputs  for  the  corresponding  inputs  [56].  Two  main  sensitivity 
measures  used  in  this  approach  are  the  first  order  and  total 
effects.  The  first  order  effects  consider  the  main  effects  for  the 
output  variations  due  to  the  corresponding  input.  The  total  effects 
account  for  the  total  contributions  to  the  output  variance  due  to 
the  corresponding  input,  which  include  both  first  order  and 
higher-order  effects  because  of  interactions  among  inputs.  Hence, 
the  difference  between  the  first  order  and  total  effects  can  show 
the  effects  of  interactions  between  variables.  If  the  objective  of 
the  research  is  to  fix  the  factors  which  are  not  important  in  the 
energy  models,  the  total  sensitivity  effects  should  be  used.  In 
contrast,  if  the  purpose  is  to  prioritize  energy  saving  measures, 
the  first  order  effects  are  a  better  choice. 

This  variance-based  method  is  regarded  as  model  free 
approach,  which  means  it  is  suitable  for  complex  nonlinear  and 
non-additive  models.  This  method  can  quantify  all  the  variance  of 
the  output  due  to  every  input  and  it  can  also  consider  the 
interaction  effects  among  variables.  The  drawback  of  this 
approach  is  its  high  computational  cost.  Two  commonly  used 
methods  are  FAST  (Fourier  Amplitude  Sensitivity  Test)  and  Sobol 
[14],  The  classical  FAST  method  considers  only  the  nonlinear 
effects,  but  not  interaction  effects.  The  Sobol  method  can  decom¬ 
pose  all  the  output  variance,  which  means  no  variance  for  the 
output  is  left  in  the  analysis.  However,  the  Sobol  method  is  much 
more  computational  expensive  compared  to  other  global  sensi¬ 
tivity  analysis  methods.  For  instance,  the  total  number  of  simula¬ 
tion  runs  is  608  if  there  are  8  input  factors  and  the  second  order 
effects  are  needed  in  the  analysis  [59]. 

Both  FAST  and  Sobol  methods  have  been  used  in  exploring 
building  energy  performance  [12,15,42-44].  Mechri  et  al.  [12] 
implemented  FAST  method  to  identify  the  key  design  variables 
affecting  building  thermal  performance  for  a  typical  office  build¬ 
ing  in  Italy.  The  results  indicate  that  the  envelope  transparent 
surface  ratio  is  the  most  important  factor  for  both  heating  and 
cooling  energy.  Spitz  et  al.  [44]  used  the  Sobol  method  with  6669 
simulation  runs  to  identify  the  most  influential  parameters  for  an 
experimental  house  in  France.  The  six  important  factors  affecting 
the  air  temperature  are:  heating  capacity,  infiltration,  fibreglass 
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thickness,  heat  exchanger  efficiency,  internal  heat  gains,  and 
fibreglass  conductivity.  Ruiz  et  al.  [43]  implemented  variance- 
based  method  to  determine  the  key  factors  affecting  final  energy 
consumption  in  office  buildings  in  six  Europe  cities.  The  results 
show  that  the  first  order  effects  can  account  more  than  90%  of  the 
variance  of  outputs  and  the  climate  is  the  most  influential  factor 
influencing  final  energy  consumption. 

3.2.4.  Meta-model  based  method 

Meta-modelling  sensitivity  analysis  is  a  two-stage  approach 
[14],  First,  a  meta-model  is  created  using  non-parametric  regres¬ 
sion  methods,  which  do  not  have  a  predetermined  form  (such  as 
linear  or  nonlinear  regression)  and  consequently  it  can  be  suitable 
for  complex  models.  Second,  sensitivity  measures  are  calculated 
using  this  meta-model  based  on  variance-based  method.  The 
meta-model  is  to  approximate  the  objective  functions  using 
statistical  (or  machine  learning)  models  [60].  The  main  point  of 
using  meta-models  is  that  running  meta-models  needs  much  less 
time  than  running  detailed  building  energy  simulation  models. 
Hence,  this  meta-modelling  method  can  provide  more  efficient 
sensitivity  index  compared  to  variance-based  method  [49].  This 
method  can  also  quantify  the  variance  of  the  output  for  different 
input  factors  since  it  used  variance-based  method  as  described  in 
Section  3.2.3. 

The  commonly  used  meta-models  in  sensitivity  analysis 
include  MARS  (Multivariate  Adaptive  Regression  Splines)  [52], 
ACOSSO  (Adaptive  Component  Selection  and  Smoothing  Opera¬ 
tor)  [52],  Support  vector  machine  [61  ],  GP  (Gaussian  process)  [62] 
and  TGP  (treed  Gaussian  process)  [55].  MARS  combines  spline 
regression,  stepwise  model  fitting,  and  recursive  partitioning  [52]. 
ACOSSO  can  be  regarded  as  a  weighted  or  adapted  COSSO 
(component  selection  shrinkage  operator)  which  uses  a  rescaling 
norm  to  allow  for  more  flexible  estimation  of  the  functional 
components  [52].  GP  model  generalized  multivariate  Gaussian 
distributions  over  finite  dimensional  vectors  to  infinite  dimen¬ 
sionality  and  has  become  very  popular  in  the  machine-learning 
field  [62].  Support  vector  machine  (SVT)  is  a  very  popular  choice 
in  supervised  learning,  which  produces  nonlinear  boundaries  by 
constructing  a  linear  boundary  in  a  large  and  transformed  version 
of  the  feature  space  [61],  TGP  is  to  provide  fully  Bayesian  non¬ 
stationary  and  nonlinear  regression  models  in  order  to  improve 
prediction  power  [55].  For  detailed  descriptions  on  these  models, 
please  refer  the  corresponding  documents  listed  here. 

This  method  is  still  new  in  the  field  of  building  performance 
analysis  [9,45,46].  De  Wilde  et  al.  [45]  used  MARS  meta-model  to 
assess  the  influences  of  climate  change  on  a  UK  office  building. 
They  found  that  the  three  important  variables  influencing  over¬ 
heating  risk  in  this  building  are  lighting  gains,  equipment  gains, 
and  weather  conditions,  which  can  account  for  more  than  90%  of 
variations  of  outputs.  Tian  et  al.  [9]  implemented  ACOSSO  method 
to  investigate  the  thermal  performance  of  a  campus  building  in  the 
UK  The  results  show  that  the  four  key  variables  affecting  annual 
carbon  emissions  are  lighting  gains,  solar  heat  gain  coefficients  of 
windows,  cooling  degree  days,  and  equipment  heat  gains.  These 
four  factors  are  responsible  for  around  95%  of  the  output  variances. 
Eisenhower  et  al.  [46]  used  a  meta-model  method  for  sensitivity 
analysis  based  on  support  vector  machine  to  assess  energy  perfor¬ 
mance  in  a  two-storey  multi-functional  building,  which  includes  a 
drill  deck,  offices,  and  administrative  rooms. 

4.  Other  topics  related  to  sensitivity  analysis  in  building 
performance  analysis 

This  section  will  discuss  four  topics  which  are  related  to  the 
application  of  sensitivity  analysis  in  assessing  building  thermal 


performance:  apply  sensitivity  analysis  in  observational  study; 
deal  with  correlated  input  factors;  calculate  the  variations  of 
sensitivity  index;  choose  software  for  sensitivity  analysis. 

4.1.  Observational  study 

The  discussion  so  far  is  only  related  to  sensitivity  analysis  from 
building  energy  simulation  model  in  which  the  design  of  compu¬ 
ter  experiments  can  be  used  with  classic  design  experiments  or 
modern  sampling  methods  [63],  Sensitivity  analysis  can  be  also 
used  in  observational  study  in  the  field  of  building  energy 
analysis.  Since  the  input  data  in  this  case  is  directly  from  actual 
buildings,  the  sampling  method  cannot  usually  be  implemented. 
As  a  result,  the  following  methods  are  not  valid  in  this  case;  local, 
screening  and  variance-based  method.  Regression  and  meta¬ 
model  method  for  sensitivity  analysis  are  suitable  for  this 
application. 

The  studies  on  observational  studies  using  sensitivity  analysis 
are  mostly  related  to  building  stock  in  the  domain  of  building 
energy  analysis.  The  analyst  usually  obtains  the  inputs  and  out¬ 
puts  from  building  survey  in  a  number  of  buildings.  Then 
sensitivity  analysis  can  be  used  to  determine  the  key  factors 
affecting  building  performance  (often  energy  use  intensity  stan¬ 
dardized  by  floor  area)  in  these  buildings.  Moran  et  al.  [8]  applied 
step-wise  regression  to  obtain  energy  models  for  historic  dwell¬ 
ings  in  Bath,  UK  The  statistical  analysis  from  SRC  indicates  that 
the  number  of  open  flues  is  the  most  important  factor  influencing 
heating  energy  consumption  in  these  buildings.  For  electricity 
use,  the  two  important  factors  are  the  number  of  occupants  and 
the  use  of  an  electric  range.  Zhao  et  al.  [34]  investigated  energy 
performance  of  commercial  and  hotel  buildings  using  stepwise 
regression  and  SRC  in  China.  The  results  indicate  that  building  age 
is  the  only  significant  factor  for  commercial  buildings,  while  the 
three  important  factors  for  hotel  buildings  are  building  area,  total 
number  of  guest  room,  and  equivalent  number  of  guest  rooms. 

It  should  be  noted  that  the  inputs  from  building  stock  may  be 
correlated.  For  example,  building  age  may  be  correlated  with 
building  area,  which  means  that  the  buildings  with  higher  or 
smaller  area  are  likely  built  for  a  specific  time  period.  Another 
example  is  that  building  geometry  parameters  may  be  correlated 
in  a  given  building  stock.  For  instance,  building  floor  number  may 
increase  with  building  floor  area  to  some  extent  in  a  building 
stock.  Hence,  it  is  necessary  to  take  into  account  the  effects  of 
these  correlated  inputs  in  applying  sensitivity  analysis  in  building 
stock  research.  However,  most  of  previous  research  did  not 
consider  them.  The  next  section  (Section  4.2)  will  focus  on 
this  topic. 

4.2.  Correlated  inputs 

It  is  not  uncommon  that  input  parameters  may  be  correlated 
in  building  energy  analysis  as  described  in  the  end  of  the  last 
section  (Section  4.1).  When  the  inputs  (also  called  predictors)  are 
correlated,  this  phenomenon  is  called  collinearity  (or  multicolli- 
nearity).  The  collinearity  leads  to  large  variances  of  some  esti¬ 
mated  regression  coefficients,  and  then  may  lead  to  unstable 
regression  equations  [64].  Therefore,  the  regression  equation  is 
not  easily  interpretable  as  the  regression  models  from  uncorre¬ 
lated  inputs.  The  SRC  or  t-values  as  discussed  in  Section  3.2 
cannot  be  used  in  the  presence  of  correlated  factors. 

Many  methods  have  been  developed  to  deal  with  the  correla¬ 
tion  inputs  for  assessing  relative  importance  of  inputs  [65-67]. 
Here,  we  recommend  three  new  methods:  LMG  (Lindeman, 
Merenda,  and  Gold)  [66],  PMVD  (Proportional  marginal  variance 
decomposition)  [66],  and  conditional  variable  importance  from 
random  forest  [68].  Both  the  LMG  and  PMVD  methods  can 
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Table  2 

R  packages  for  sensitivity  analysis 


Package 

Sensitivity  analysis  method 

Characteristics 

R  sensitivity  [70] 

SRC,  SRRC,  PCC,  PRCC,  Morris,  FAST,  Sobol 

Confidence  intervals  of  sensitivity  analysis 

R  CompModSA  [73] 

SRC,  SRRC,  MARS,  ACOSSO,  GP 

Suitable  for  complex  models  (at  least  50  simulation  runs), 
but  for  uncorrelated  inputs;  bootstrapping  confidence  intervals 

R  tgp  [55] 

TGP 

Suitable  for  complex  model, 
but  uncorrelated  inputs 

R  relaimpo  [71] 

LMG,  PMVD 

Suitable  for  correlation  inputs  from  observational  data, 
but  assume  linear  models 

R  party  [74] 

Conditional  permutation  importance 
from  random  forest 

Suitable  for  correlated  inputs  from  non-linear  models 

Notes:  SRC,  standardised  regression  coefficients  [47];  SRRC,  standardized  rank  regression  coefficient  [47];  PCC,  partial  correlation  coefficients  [47];  PRCC,  partial  rank 
correlation  coefficient  [47];  FAST,  Fourier  amplitude  sensitivity  test  [49];  MARS,  multivariate  adaptive  regression  splines  [52],  ACOSSO,  adaptive  component  selection  and 
smoothing  operator  [52],  GP,  Gaussian  process  [62];  TGP,  treed  Gaussian  process  [55J;  LMG,  Lindeman,  Merenda,  and  Gold  [66];  PMVD,  Proportional  marginal  variance 
decomposition  [66J. 


decompose  the  coefficients  of  determination  (R2)  into  non¬ 
negative  values  by  averaging  over  orderings.  The  PMVD  method 
is  closer  to  a  conditional  index  in  comparison  with  the  LMG 
approach.  These  two  approaches  are  only  suitable  for  linear 
models.  If  the  results  from  LMG  or  PMVD  method  indicate  that 
there  is  a  large  variation  of  the  outputs  unexplained  (i.e.,  non¬ 
linear  effects  in  the  model),  the  conditional  variable  importance 
from  random  forest  can  be  used  [68].  This  new  index  is  based  on 
random  forest  approach,  which  is  a  popular  machine  learning 
algorithm  to  handle  non-linear  models  and  large  databases.  Strobl 
et  al.  [68]  proposed  this  new  conditional  variable  importance 
(similar  to  partial  correlation)  to  be  more  suitable  in  the  case  of 
correlated  factors.  Note  that  all  these  three  methods  are  compu¬ 
tationally  expensive,  especially  for  a  large  number  of  input  factors 
or  simulation  runs.  For  more  detailed  discussion  on  these  three 
methods  and  other  relative  importance  approaches  suitable  for 
correlated  inputs,  please  refer  to  [65-68]. 

For  building  energy  simulation  models,  the  analyst  can  also 
consider  the  correlation  structure  of  inputs  in  the  generation  of 
sampling  as  long  as  the  analyst  has  these  correlated  data  or 
correlation  matrix  among  input  factors.  For  example,  the  actual 
lighting  power  density  may  be  correlated  with  the  occupancy 
density  in  a  building.  Three  methods  can  be  used  for  this  case; 
Iman  Conover,  Dependency  tree,  and  Stein  [56].  The  first  method 
(Iman  Conover)  can  directly  induce  a  rank  correlation  among 
inputs.  The  second  method  (Dependency  tree)  can  define  the 
correlation  structure  by  using  undirected  acyclic  graphs  to  form  a 
tree  structure.  The  third  method  (Stein)  can  use  the  correlated 
sample  in  generating  the  new  sample  for  inputs.  Please  refer  to 
[56,59]  for  detailed  descriptions  on  these  methods. 

4.3.  Variations  of  sensitivity  index 

Sensitivity  indexes  from  most  of  previous  studies  are  only 
point  estimate  in  the  field  of  building  energy  analysis.  Compared 
to  point  values,  the  intervals  for  sensitivity  indexes  can  provide 
robust  results  from  sensitivity  analysis.  Bootstrapping  is  a  com¬ 
mon  method  used  to  create  the  variations  of  different  sensitivity 
indexes.  It  the  data  can  be  assumed  as  an  independent  popula¬ 
tion,  a  new  data  set  can  be  obtained  by  random  sampling  with 
replacement  from  the  original  dataset  [69].  This  process  is 
repeated  until  all  the  samples  required  are  created  in  this  way. 

The  bootstrapping  method  has  been  implemented  in  several 
packages  to  construct  the  intervals  for  sensitivity  index.  R  sensi¬ 
tivity  package  [70]  has  this  function  to  calculate  the  intervals  for 
various  sensitivity  index,  such  as  SRC,  PCC,  SRCC,  PRCC  Another  R 
package  relaimpo  package  [71]  also  can  calculate  the  intervals  for 
sensitivity  analysis,  especially  in  the  case  of  correlated  factors.  For 
meta-model  sensitivity  analysis,  Storlie  et  al.  [52]  has  developed  a 


R  package  to  compute  the  confidence  intervals  for  sensitivity 
measures  using  bootstrapping  method. 

4.4.  Software  issues 

There  are  many  statistical  programs  for  sensitivity  analysis. 
We  recommend  two  programs:  Simlab  [59]  and  R  [72],  Both  of 
them  are  free  and  have  many  types  of  sensitivity  analysis 
approaches  described  in  this  paper. 

Simlab  is  a  free  statistical  program  for  uncertainty  and 
sensitivity  analysis.  Many  researchers  have  used  this  program  in 
assessing  variable  importance  in  building  performance  analysis 
[2,9,12,13,28,37,40,43].  Simlab  has  several  different  types  of 
sensitivity  analysis  methods,  which  include  SRC,  SRRC,  Morris, 
Sobol,  FAST  Simlab  has  two  versions:  a  legacy  version  with  a 
standard  desktop  application  with  graphical  user  interface;  a  new 
version  with  Matlab,  Fortran  or  C/C compiler.  These  features 
make  Simlab  very  flexible  to  be  suitable  for  different  applications. 

R  is  an  open-source  free  software  environment,  which  has 
cutting  edge  methods  developed  by  leading  statisticians  around 
the  world  [72].  Another  advantage  of  using  R  is  to  promote 
reproducible  research  by  using  R  and  sharing  R  code  in  the  field 
of  building  performance  analysis.  R  has  many  different  types  of 
sensitivity  analysis  methods  with  R  packages  as  listed  in  Table  2. 
R  sensitivity  package  [70]  has  similar  functions  to  Simlab  and  it 
also  can  calculate  intervals  of  sensitivity  index  as  described  in 
Section  4.3.  R  CompModSA  package  [73]  can  deal  with  non-linear 
models  using  non-parametric  regression  methods.  R  tgp  package 
[55]  has  used  treed  Gaussian  process  models  for  sensitivity 
analysis  in  which  a  unique  feature  is  to  show  how  the  output 
responds  to  every  input  variable  by  considering  the  variations  of 
main  effects.  R  relaimpo  [71]  and  party  [74]  packages  can  handle 
the  correlated  inputs  to  assess  the  relative  importance  of  vari¬ 
ables.  The  difference  is  that  the  former  (R  relaimpo)  is  only 
suitable  of  linear  models,  while  the  latter  (R  party)  can  be  used 
for  non-linear  models. 

5.  Conclusions  and  further  work 

This  paper  has  reviewed  the  methods  of  sensitivity  analysis 
in  building  energy  analysis.  The  findings  and  recommendations 
of  the  application  of  sensitivity  analysis  in  assessing  thermal 
performance  in  buildings  are  summarized  as  follows. 

(1)  The  local  sensitivity  analysis  is  the  simplest  method  and  still 
very  useful  in  building  performance  analysis  even  with  its 
shortcomings.  This  is  due  to  its  low  computational  cost,  simple 
implementation,  and  easy  interpretation.  The  limitation  of  this 
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method  is  that  it  only  explores  small  portion  of  the  possible 
space  of  input  values. 

(2)  The  global  sensitivity  analysis  methods  have  been  increas¬ 
ingly  applied  in  building  energy  analysis  to  identify  the  key 
variables  affecting  building  thermal  performance.  It  is  neces¬ 
sary  to  automate  the  process  of  creating  energy  models  and 
collecting  the  results  from  simulation  because  of  more  simu¬ 
lation  runs  for  global  sensitivity  analysis.  Hence,  the  building 
simulation  programs  with  only  GUI  (graphical  user  interface) 
are  hard  to  implement  this  method. 

(3)  The  choice  of  sensitivity  analysis  methods  depends  on  many 
factors,  which  include  the  research  purpose,  the  computa¬ 
tional  cost  of  energy  models,  the  number  of  input  variables, 
the  analyst’s  time  for  a  project,  the  familiarity  of  sensitivity 
methods.  The  practical  advice  of  using  sensitivity  analysis  is 
as  follows,  (a)  The  regression  method  may  be  still  the  first 
choice  because  it  only  requires  moderate  computational  cost 
in  the  field  of  building  performance  simulation.  If  the  results 
from  regression  method  indicate  there  is  a  large  proportion  of 
the  output  variance  unexplained  by  regression  models,  the 
meta-model  sensitivity  analysis  can  be  used  to  determine  the 
most  influential  factors  in  the  analysis  without  running  extra 
energy  simulation  runs,  (b)  For  high  computational  energy 
models,  a  good  choice  can  be  the  Morris  method  if  there  are  a 
large  number  of  input  variables  and  the  analyst  only  needs 
qualitative  analysis,  whereas  a  better  choice  may  be  the  meta¬ 
model  sensitivity  analysis  in  order  to  quantify  the  variance  of 
output  for  every  input,  (c)  The  variance-based  method  can 
give  more  reliable  results  at  the  cost  of  increased  computa¬ 
tional  time,  (d)  For  observational  study  on  building  energy 
performance,  the  regression  or  meta-model  sensitivity  analy¬ 
sis  can  be  used,  while  the  screening  or  variance-based  method 
is  inappropriate.  This  is  because  the  screening  or  variance- 
based  methods  are  dependent  on  the  sampling  approaches  for 
the  input  factors. 

(4)  The  variations  of  inputs  in  the  analysis  depend  on  the 
research  purpose.  If  the  analyst  plans  to  explore  the  effects 
of  different  building  design  options,  the  distributions  for  these 
variables  may  use  uniform  distribution.  If  the  purpose  is  to 
investigate  the  possible  range  of  thermal  performance  for  an 
existing  building,  the  normal  distributions  may  be  used  for 
most  of  variables.  More  research  is  needed  for  the  second 
application. 

(5)  The  variations  of  sensitivity  index  need  to  be  computed  in 
order  to  provide  more  robust  results  for  sensitivity  analysis. 
Bootstrapping  technique  can  be  very  useful  for  this  purpose. 

(6)  Care  should  be  taken  when  implementing  sensitivity  analysis 
in  the  presence  of  correlated  inputs.  This  may  occur  in  dealing 
with  the  data  from  building  stock  research. 
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